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This paper studies the low-SNR regime performance of a scalar complex K-usei interference channel with Gaussian noise. 
The finite bandwidth case is considered, where the low-SNR regime is approached by letting the input power go to zero while 
bandwidth is small and fixed. We show that for all S > there exists a set with non-zero measure (probability) in which the 
wideband slope per user satisfies So < 2 /k + S. This is quite contrary to the large bandwidth case Qj, where a slope of 1 per 
user is achievable with probability 1. We also develop an interference alignment scheme for the finite bandwidth case that shows 
some gain. 

I. Introduction 

This paper and the companion paper [1] study the bandwidth-power trade-off of a K-user interference channel in the 
low-SNR (signal-to-noise) regime, where explicitly 
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Bandwidth and input power, two important design parameters, are related by the function R I J, where is the transmitted 
energy per bit, and R is the spectral efficiency. The concept of the low-SNR regime was introduced by S. Verdu in the 2002 
paper [2]. A system working in this regime is characterized by very small spectral efficiency, so that the R (jyj^ curve can 
be closely approximated by its first-order approximation, which is determined by two measures: the minimum energy per bit 
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and the wideband slope 5 . -f^ 



is the minimum transmitted energy per bit required by reliable communication, 
which is generally achieved at zero spectral efficiency; and So is the first-order slope of R ( -f^ J as jf- approaches jf- 
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These two measures are defined by 
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Further manipulations in show that 
at zero SNR: 
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and So can be determined by the first and second order derivative of R (SNR) 
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where R (0) and R (0) are the first-order and the second-order Taylor expansion coefficients for SNR — > 0. R (0) 



rffl(SNR) 
dSNR 



and R (0) = d ~fS R) if R (SNR) is differentiable. 

SNR=0 V ' rfSNR " V ' 
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What is interesting is that there are two distinct ways to approach the low-SNR regime, which have very different impacts 
on the performance of the interference channel Although approaching the low-SNR regime by letting B — > oo is emphasized 
in previous papers (hence the term "wideband slope"), it is not the only way. As can be noted from the definition of SNR (fl]), 
SNR approaches zero if either B — > oo or P — s- 0. Consider a point-to-point AWGN channel with spectral efficiency 
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R = log 1 
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The low-SNR results are based on a Taylor series of log(l + x) , as also seen by (@]|5]l; therefore as long as SNR = — > 
in any manner, low-SNR results such as minimum energy per bit and wideband slope are unchanged. The key is that the 
spectral efficiency R — > 0, not that B — > oo. For the interference channel, on the other hand, different results are obtained 
depending on how the low-SNR regime is approached. 

In the first approach, let B — >• oo while P is fixed and finite. We call this the large bandwidth regime. In (1] we proved 
that in this case a wideband slope of K was achievable with probability one by using channel delays. 

In the second approach, let P — > while B is fixed and finite. In this case, the rate BR in bits/s must necessarily approach 
as well, and we therefore call this the low-rate regime. This is the case considered in this paper, and as will be seen the 
results are quite different than the the case in (TJ. 

To put the results of this paper in context, consider the completely symmetric channel: the channel between receiver pairs 
is the same for all 1 < i,j < K, both i = j and i ^ j. We call this channel the l_-channel. The capacity of this channel is 
fully known: because of the symmetry all receivers must be able to decode all messages, and the capacity is therefore given by 
the MAC (multiple access channel) bound into one of the nodes. For this channel, FDMA (frequency division multiple access) 
or TDMA (time division multiple access) is optimum, and the degrees of freedom Q is 1 (1/K per user) while the wideband 
slope is 2 (2/K per user). A key question is if this channel is typical. For degrees of freedom the answer is no: the results in 
|4| and |5| show that the degrees of freedom is K/2 (i per user) almost everywhere for a scalar channel. Thus, the degrees of 
freedom is discontinuous in 1, and in fact almost everywhere. Similarly, [3| shows that for time-varying channels, the degrees 
of freedom is K/2 with probability one. In [Q we proved analogously that in the large bandwidth regime the wideband slope 
is K(l per user) with probability one for a line-of-sight channel. Thus, also the wideband slope is discontinuous in 1 and 
again in fact discontinuous with probability one. 

The main result of this paper is that in the low-rate regime the wideband slope is upper semi-continuous in 1. That is, for 
any S > there exists an open set Cs of channels so that 1 6 cl(Ca) (cl means closure) and So < 2 + S in C$. While this does 
not give a complete characterization of the wideband slope as in [T), it does show that interference alignment in the low-rate 
regime does not give the same dramatic gain in performance as in the large bandwidth and high SNR regimes. We still show 
that interference alignment can outperform TDMA, but in line with the outer bound, not by much. 

II. System Model And Preliminaries 
In IH we derived the following baseband model for the interference channel (in a line-of-sight model): 

Vj N = C n x 3 N + C i i$i t n ~ n ^ + Z J M 

where 

oo 

x i[ n ] = Xi[m]smc(n — m + Sji). (6) 



and 



n 3i = [rjiB + W (7) 
S-a = t 31 B - [ Tji B + \\ (8) 
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are the symbol and fractional delays, respectively. It was these delays that allowed interference alignment in HI as B — > oo. 

In the present paper we keep B fixed; we will further assume that B is so small that the delays are insignificant, riji = 
0, Sji » 0, and we therefore arrive at the usual model for the interference channel, 



yj[n] = CjjXi[n] + 22CjiXi[n] + Zj[n], (9) 

where Cji is a complex scalar and the noise Zj is i.i.d. (independent, identically distributed) circularly symmetric complex 
random variable with distribution CAf (0, BNq); since B does not play any role in the rest of the paper we will put B = 1 
and omit it from future formulas. Notice that the model (0 is valid also for a non line-of-sight model, as long as delays along 
all paths are insignificant. 



A. Circularly Asymmetric Signaling 

To characterize the Shannon capacity region of the model (0, most research restricts the inputs to be circularly symmetric, 
i.e., the the real part of the input Re{xj} and the imaginary part of the input Imj.Tj} are i.i.d.. However, [6| shows that 
circularly asymmetric signaling achieves higher degree of freedom in the high-SNR regime. Although the specific interference 
alignment technique they proposed is not applicable to the low-SNR regime, that work still has inspired our interference 
alignment for the low-SNR regime. In section [IV] we will see that circularly asymmetric signaling indeed benefits system 
performance. 

In circularly asymmetric signaling, the transmitters are allowed to allocate power on real and imaginary dimensions, and 
the real part of the input Re {xj} is allowed to be correlated with the imaginary part of the input Im {xj}, while in circularly 
symmetric signaling, Re{xj} and Imjij} are required to be i.i.d.. To characterize such transmission schemes, it is more 
convenient to consider the scalar complex channel as a two-dimensional vector real channel. 

Following [6|, we extend (0 into an equivalent two-dimensional real channel, 

K 

Yj = \Cn\X j+ {CfilUjilCi + Zj (10) 

A / cos (4>ji) —sm((f>ji) \ 

where IX, = I is the rotation matrix with angle (pji, and the 2x1 vector white Gaussian noise 

V sin(^i) cos J 

is Z_. ~ AT (0, -^12x2)- Notice that we let receiver j be phase-synchronized with the received Xj so that cf>jj = 0. Without 
without loss of generality, we can assume Nq = 1 whenever convenient. 

(Re {a; } \ 
] . We assume that an (2 nRj , n) code 
Im {xj } J 

is used at receiver j, for j = 1, • • • , K. At the transmitter j, the input message Wj is drawn uniformly randomly from the 
index set {l, • • ■ , 2 nRj }, and a deterministic function yields the length n transmitted codeword Xjj (Wj). The codebook of 
user j is composed by the set of codewords Jf" (1) , ■ • • , X" (2 nR 3), We require each user to satisfy power constraint Pj/b 
per second per Hz. Recall that we may assume B = 1. Denote the ith entry of X " by X^p . Therefore the input must satisfy 
constraint 

n ^ 

i=l 



iV„ (11) 



where Tr (Vj) = Pj, j = 1, • • • , K. For any two given matrices A and B, the notation A < B means that the matrix B — A 
is positive semi-definite. Notice that given the assumption B = Nq = 1, we have 

SNR, = 

3 BN Q 

= Pj (12) 

Corresponding to the X™ (Wj) codebook , we also define four Gaussian random variables X!jc X_jQ, XljG^ an< ^ YjG as 
follows for later use. Let X! jG be i.i.d. vector Gaussian random variable, X! jG - Af (0, V^), where = ^ J2n=i ¥j (2Q ) . 
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Vj X Vj given power constraint ( fTTT i. Let 2Lj G be i.i.d. vector Gaussian random variable, Xj G ~ Af (0, Vj). Y_j G and Y- G 
are defined as 

if 

= |C J - j |X^ G + ^ |C J - < |U i ,-2fJ G + ^. 

£ l^i|U ii 2f iG + 4,- 



B. Performance Criterion And Performance Measures 

For more than two users it is complicated to compare complete slope regions, and we are therefore looking at a single 
quantity-the sum slope Sq, to characterize performance. The formal definitions are as follows. 



Definition 1 (Sum slope). Sq is defined as the first-order slope of the R s 



Mb 

No sum. 



— 3-1 J — -. It characterizes the wideband slope of R s 
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Denote the sum power constraint by P sum = J2j=i Pj- Under the assumption that NqB = 1, 
from the first and second order derivatives of R sum (P SU m)' 
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and So can be obtained 

(15) 
(16) 



Notice that constraints on Pj or Rj are required for a well-posed problem; otherwise the best low-SNR performance is 
achieved by allocating all power to the user with largest direct link gain so that is minimized. Such a solution is just 

min 

a single user solution and gives no insight into the interference channel. To fix this insufficiency while keeping our problem 
relatively simple to analyze, we require the interference channel to work under the equal-power constraint, which is defined 

as 



Definition 2. Equal power constraint is the case where the sum rate R s 
■■■ = P K . 



is maximized under the constraint Pi = P^ 



Given (0, we can see that ;/ two systems achieve equal 



slope approaches its minimum value faster, and the system is therefore more spectrally efficient. On the other hand, we should 
notice that the priority in the low-SNR regime is to minimize ^ t 

min 

statement: 

Remark 3. To make fair comparison of the wideband slopes between different systems, they must have equal 
first place. 



value, the jf- value of the system with higher wideband 
icti 

. Based on this observation, we make the following 

in the 



The results in Q reveal that the optimal achievable minimum energy per bit of an interference channel is equal 

min 

to that of its corresponding interference-free channel. The first-order optimality criterion under the equal power constraint is 
stated in the following lemma. 
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Lemma 4. The optimal minimum energy per bit of the interference channel defined by (O is 

E b K\og e 2 



under the equal power constraint. 



K ,2 (17) 
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Given Remark \3\ any achievable scheme or capacity outer bound gives valid bound on the sum slope only if it has correct 

values, stated in Theorem [4] 
For performance measure we use 

S 



ASn = 



^o,no interference 



The quantity S no inteference * s ^ e wideband slope of the corresponding interference-free channel: 



Rj = log(] • C,, -I', 

We can interpret A5o as the loss in wideband slope due to interference. 

Under the equal power constraint, 5o,no interference the sum slope of the interference-free channel, and So.tdma and So,tin 
the sum slope achieved by TDMA and treating interference as noise (TIN) respectively, are listed as follows for comparison 
purposes; they can be obtained directly obtained from (H]|5]l 

_ o (Sj|Cjj| 2 ) 18) 

'-'Ojiio interference * r 



The R sum (P sum ) achieved by TIN is 



Rsum(Psum) = X>g ( 1 + \ C n\ ^um 



which gives 



S tin = 2 -. ^— '- r ; (19) 

Ef=i(i^i 4 +2E^i^i 2 i^r 



AS = 7 (20 ) 

Ef=i(lQ,l 4 + 2E^IQ l | 2 |c JJ | 2 



1 K 

*um (^sitm) ~j~ ^ ^ lo§ ^1 H~ I^JJ I Psur 

.7=1 



The i? SMm (P sum ) achieved by TDMA is 
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which gives 
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S = — /- (21) 

* E,-I%l 4 

A5 = 4 (22) 
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III. Generalized Z-Channel Outer Bound 

In this section, we develop a new outer bound on the wideband slope for a set of the 2-dimensional vector channels defined 
by ([Tol l, under the equal power constraint. The outer bound is specific to the low-rate regime. 

The outer bound is derived from the sum Shannon capacity of a type of generalized Z-channel, which is constructed by 
elimination of a subset of the interference links. In Section IIII-AI we show that for a subset of channels C, the optimal sum 
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capacity of their corresponding Z-channels can be achieved by i.i.d. 2-dimensional vector Gaussian inputs. Further, assuming 
that channel coefficients Cji is drawn from i.i.d. continuous distribution, the set C has non-zero probability. In Section Ull-B I 
the Z-channel outer bound is used to derive an outer bound on the wideband slope. 

A. Generalized Z-Channel And Its Sum Capacity 

We define the generalized Z-channel corresponding to the interference channel ( TTOb as 

K 



(23) 
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Figure 1. Generalized Z-channel 

Eliminating a subset of interference links will not reduce channel capacity and therefore, the sum capacity outer bound for 
the generalized Z-channel is also a sum capacity outer bound for the interference channel. 

To derive the Z-channel sum capacity, we provide receiver j, j = 2, • • • , K with side information S™ = (s^i,---, S^O'- 1 )) ' 
where 



S"; 



K 

i=i+i 



(24) 



p = 1, • ■ • , j — 1. . The entries in the length n noise vector W" r are i.i.d 2x1 vector Gaussian noise with the same marginal 
distribution as Zj. Further, they satisfy the following properties 

• WJj(j -i)t " ' " j Wji are independent of all input length n codewords X™, i = 1, • • • , K; 



■iO'-i)' ' ' ' 



• * Win j are jointly Gaussian random variables, with zero mean and covariance matrix 
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To guarantee such multivariate Gaussian random variable exists, Ajk should be chosen such that for all j = 1, 

K Sj h 

We emphasize the following property of JCs } , which will play a key role in the proof of the main result. 



Lemma 5. The distributions of S^j_x)p 



^■0'-i)(p-i)'' 



i 1)1 s r^-Tj—i) Sjp | ±Lj(p—i) ? * ' " ? ^ji equal. 
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Proof of Lemma [5] is in Appendix lAl 



Lemma 6. The distributions of Y_j_i 



y(j-2)''""' H.j 



L(j-l)(i-2)' ■ ' • > ^0-1)1 ' ^0-1) flMc/ 

The proof of Lemma [6] is almost identical to the proof of Lemma [5] and will therefore be omitted. 
Define the average covariance matrix of the input at transmitter as 

T 



SJh are equal. 
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for any length n input sequence X". It must satisfy the power constraint defined in (fTTT ). i.e., Vj ^ Vy. The next lemma 



states how to choose A 



Lemma 7. Let A,„, j = 2, • • ■ , K and p = l, 
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If Ajp defined by \27\ satisfy ^ 0, then 
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J"1G' " ' ' ^3(J-1)G 



(28) 



forms a Markov chain for all j = 2, • 
Here 2£j G an d Z^g are defined in section III-AI the proof of Lemma [7] is in Appendix |B] 

For a channel realization, denote its channel coefficients by C_ = {Cji; i, j = 1, • • ■ , K}. In the following lemma, we state 
a sufficient condition on C_ so that >^ if Aj- p is chosen according to $T7\ . 

Lemma 8. For any < a < 1 fnere exist some e a , e' a > a/ia" e^(£Z) > so mat if 

,2 



l&i|<4} 



IC-i 



(29) 
(30) 



^ < 4(c) 

then K-Sj /or Aj p chosen according to \27\ . 
Proof of Lemma [8] is in Appendix [C] 

Our main result of this section is stated in the following theorem. 

Theorem 9. For every interference channel realization C_ G C = U a e(o l) ^ a defined by \29\ there exists an e'^(C_) > so 
that if Pj < (C_) the sum capacity of its corresponding Z-channel is given by 
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E 



K 

max ^2l(x jG ;Y jG 
V j hO,j = l,->-,K 



(31) 
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K 

= max log 

Tr:V,.- /' 

Because the sum capacity of the interference channel is outer bounded by the sum capacity of the generalized Z-channel, ( 1571 ) 
is an outer bound for the sum capacity of the interference channel. 

Proof of Theorem [9] is in Appendix [D] 

Note that the bound in Theorem [9] is valid for Pj < e^(C), and it therefore bounds the actual capacity for suitably low 
SNR. However, we will mainly use it to bound the wideband slope, a weaker result. 



i+Ei^i 2v *J ( I+ E i^i 2 ^ 
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B. Sum Slope Outer Bound for the Interference Channel 

Given the capacity in Theorem [9] we have following result on the low -rate performance of the interference channel. 

Theorem 10. For the interference channel (O, the sum capacity is outer bounded by A31[ for low SNR. Under the equal 
power constraint, the minimum energy per bit of this upper bound satisfy the requirement imposed by Remark [3] which is 

K\og2 
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For channel realizations C_ G C = U«e(o l) defined as 
slope: 



Ef=i \Cj. 12 



(33) 



So < 



Eiq.i 



it therefore gives the following valid upper bound on the sum 
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Proof of Theorem [10] is in Appendix |E] 
Theorem 11. For the symmetric channel where Cjj = 1, Cji 

So < 




Tr V 



(35) 



Cp Tr I V ,IJ ,,V,IJ ; 



a G (0, 1) , the sum slope is bounded by 
2K 



(36) 



aK+ (1 - a) 
Proof of Theorem QT| is in Appendix [F] 

As discussed in the introduction, the wideband slope in the point C_ = 1 is per user, achievable by TDMA. Theorem 
[TT1 shows that the point C_ = 1 is not exceptional in the low-rate regime: for a close to 1 (from below) the channel with 
Cjj = 1, Cji — a has slope close to j^. However, the set of channels = 1, Cji — a still has Lebesgue measure zero, i.e., 
if the channel coefficients are drawn from a continuous distribution, this set has probability zero. The main result of the paper 
is the following theorem that shows that the set of channels with slope close to can be be extended to a set of non-zero 
measure. 

Theorem 12. For all a > 0, there exists an open set C a G C^^ -1 ) with 1 G cl ^0-^, so that for C G C a 

So < 2 + a, (37) 
If the magnitude and phase of the channel coefficients are drawn from continuous random distribution, Pr (Ca^j > 0. 
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And as a — > 0, 

lim AS = \- 

Because AiSo achieved by TDMA is jt, when a is small, TDMA transmission scheme is almost optimal for channels in C a . 
Proof of Theorem Q~2] is in Appendix [G] 

IV. Sum Slope Achievable Scheme 

In the previous section, we have shown that there exist a set of channels C a , Pr (c a ^j > 0, for which TDMA is almost 
optimal. However, we also notice that the probability that a channel realization is not in C a is likewise greater than zero. 
Therefore, it is natural to ask the question: for channels not in C a , can we find achievable schemes better than TDMA or 
Treating Interference as Noise (TIN)? 

In section llV- Al we propose a circularly asymmetric transmission scheme and analyze its theoretical performance. Simulation 
results are shown in section IIV-BI We will also discuss possible improvements of this scheme. 



A. One-Dimensional Gaussian Signaling 

In this section, we use the complex scalar channel model defined in We define a one-dimensional Gaussian signaling 
transmission scheme and analyze its performance. The idea is to align interference as much as possible. 

Definition 13. One-dimensional Gaussian signaling transmission scheme 

• At transmitter j, let input sequence be Xj [n] — Wj [nje^, where Wj [n] is drawn from i.i.d real Gaussian random 
variable with distribution A/"(0, SNR 3 ), and the phase 9j is a prior chosen design parameter, unchanged for all n during 
the transmission. 

• At receiver j, interference is treated as noise. 

We call this one-dimensional because every transmitter only transmits along e^ 9j , therefore only one dimension is used out 
of the two-dimensional signal space. 

Our objective is to find the set of phases 9 = {6±, ■ ■ ■ , 6k} that maximize the achievable wideband slope Sq. 

The achievable Sq for any 9_ is stated in the next lemma. For computational convenience, we return to the equivalent 
two-dimensional real channel model. In the equivalent 2-dimensional real channel model, the input X_. has covariance matrixw 



cos 2 8 



sin 26 



Vj Pj \ sin 2 9 j ' 

rank (Vj) = 1. We denote the normalized covariance matrix by Vj = -p 2 -. 

Lemma 14. For the equivalent 2-dimensional real channel model defined by ( liOD , the sum slope achieved by the one-dimensional 
Gaussian signaling is 

_ (SjLi \Ctj\ 2 ) 2 

5 ° Ef =1 \c» f + Ef =1 £5, \c n I 2 \c 3% \ 2 + f {ff) ' (38) 



where 



K K 



j'=i tyo 



10 



Proof: Treating interference as noise at the receiver, the achievable sum rate [13] is 
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= Ef=i ( ^ log 



1-2 H~ T r Psum 
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under the equal power constraint where SNRj 

it(0) = 
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log 
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^jr^. Combining ©, © and d40b . we have 



+4££(i^l 2 i^i 2 - 
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cos 2 ( 
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Given <S 



(40) 



(41) 



(42) 



(43) 



(|3S follows. ■ 
Given (l38i l. maximizing tSo is equivalent to finding the set of 9j that minimizes / (0) . 
Denote this optimization problem by P (9), which is defined as 

min / (g) 
subject to 9j E [—ir, 7r] . 

Notice that fljiriod 27r will not affect the value of / (9). Given the definition of the objective function in d39l l. the constraint 
9j G [— 7T, 7r] can be discarded. Therefore, P (9_) can be solved using standard numerical methods for unconstrained optimization 
problems. 



B. Simulation Results and Discussions 

In this section, we simulate the performance of the one-dimensional signaling scheme in a 10-user interference channel with 
unit direct link gains and symmetric weak interference link gains, i.e., \Cjj\ = 1 and \Cji\ = a < 1 for all i, j = 1, • • • , 10; 
the phases 4>ji is drawn from U [— tt, it] in each channel realization. This performance will be compared with existing achievable 
schemes: treating interference as noise and TDMA. 

The simulation results are presented below. We can see that when a, the ratio between the direct link gain and the interference 
link gain, is close to 1, then with non-zero probability the one dimensional Gaussian signaling transmission scheme performs 
better than TDMA. 

Fig. [2] illustrates the empirical cumulative distribution functions of the sum slope achieved by the one-dimensional interference 
alignment scheme at different a values. For comparison, Sq achieved by treating interference as noise are also shown, and 
TDMA always achievesiSo = 2 for all a value. 
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Figure 2. Empirical cumulative distribution functions of So achieved by treating interference as noise (TIN), interference alignment (INTA) and TDMA 
under different a values. 

In Figure [3] we compare the median value of Sq achieved by one-dimensional interference alignment scheme with the 
performance of treating interference as noise and TDMA. 
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Figure 3. the median value of So achieved by INTA, and the achievable So of TIN and TDMA as a function of a 



V. Conclusion 

The main result of this paper can be summarized as follows. In the low rate regime, the wideband slope is (upper semi-) 
continuous in the point 1, the point where all channels are identical, and where the wideband slope (per user) is This 
does not give a full characterization of the wideband slope. However, it is a stark contrast to the large bandwidth regime [1], 
where a wideband slope of 1 is achievable almost everywhere, implying discontinuity in the point 1. It is also a contrast to the 
high SNR regime, where i DoF per user is achievable almost everywhere Q, flU, lEL and where the DoF is discontinuous 
almost everywhere. The results in JT] and O, J4) were obtained by using interference alignment, and the result in this paper 
implies that interference alignment does not give the dramatic gains in the low rate regime seen elsewhere. Yet, we show that 
interference alignment can still give some gain. 

One implication of the result is that in networks, as opposed to point-to-point channels, it is important how the low SNR 
regime is approached. This may effect how networks are designed and operates for maximum energy efficiency. 
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Appendix A 
Proof of Lemma|5] 

Given (l24l i. we have 

K 

£y-i)p = I^o-ixjI u p(j-i)Io-i) + Y2 I^p*! u p«^ +W$j-i) P 

i=3 

K 

^0"-i)(p-i) = I^O'-iwI U (p-i)0'-i)^0'-1) + ^2\ C (p-i)t\ JJ (p-i)iX- i +W. 

K 

= \ C {j-i)i\ u i(i-i)^o-i) + \Cu\VuJC2 + W.q-i)i 
When 2Cy_i) lS given, it can be subtracted from Sa-_i) p) 5a-_i)(p_i)) • • <£(j-i)i to gi ye 



K 



Y,\Cvi\V&XS + Wl_ 1)p (44) 



1=3 



^(j-l)(p-l) - £.(j-i)(p-i) _ u ( P -i)(j-i)^-0-l) 



K 



Y2 l^p- 1 )*! u (p-i)^r +w.(j-i)( P -i) (45) 



^=3 



- £(}-i)i ~ \C(j-i)j\^iU-i)2L(j-i) 



K 



= £l C "l U u£? + W&-i)i (46) 
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while 



K 



K 



(47) 
(48) 



A' 



(49) 



We know that \Zj , ^ , W-jij & m jointly Gaussian random variables, with zero mean and covariance matrix K^. 

equal to: 

/ I 



A j(j-i) 



L J2 



A i(i-i) 



A 3 -i \ 

Ay_!)y_ 2 ) ••• A(j-_i)i 

I A 2 i 

A 21 1 



which is defined in (l27l i. It is clear that the covariance matrices of the jointly Gaussian random variables \W.{j-i) p i W-(j-i)( P -i)i ' 
and (W-jp, W-j( p -i), • • • , W-jij are tne same: 

cov (m _ 1)p , Ku-ixr-i), W (j _ in ) 



L P(P-1) 



*-p2 



p(p-i) 



A p2 



Kp-l)(p-2) 



V A 



A T 

A ( P -i)i 



A T 

A 21 



L (p-l)l 

A 2 i 
I 



(50) 



/ 



n nil 

•ip I — i(p-i)' ' 



Comparing d44l>~(f46l> and (g3~(|49]), we can see that distribution of §u-u p £y-i)(p-i), • • • , i£(i-i)i,^.™i-i) and S" p | S 1 

are equal as long as W%_ x \ p " " ' I^O'-m and — ipl — i(p-i)' " ' ' — ii have the same distribution. Recall 

that W^j is i.i.d. Gaussian random variables which is independent from the input signals X n . Therefore given d50l l. Lemma 
[5] is proved. 

Appendix B 
Proof of Lemma|7] 

Lemma [7] is proved using the following lemma from J8) . 

Lemma 15 ([8, Lemma 4, p5037]). Let X, Y_ and Z_ be jointly Gaussian vectors. If cov (Y) is invertible, then X —> Y —> Z 
forms a Markov chain if and only if 

cov (X,Z) = cov (X, Y) cov ( Y) " 1 cov ( Y, Z) 
Given Lemma [15] and the fact that cov \ Y.jQj is invertible, X_j G — > Y_jg Sj forms a Markov chain if and only if 

cov(X jG , Sj) 



QTl 
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cov 



Given d23T >, ( l24l i and the independence of W - and X_ it the left hand side of d5TT ) is 



/ ICyrvjUC-^) \ 

|C 2 ,| 2 V,U(-^-) 



V \ c U-i)i\ V J U (-^(i-i)i) / 



and the right hand side is 



A" 



|Cy | 2 V,U (-^.) £ | 2 U («^) V 4 U (-^) + I 



Et 3 \Cji\* |Ci*r u (0iO v * u (~0ii) + A 
E^j l^l 2 l^| 2 U (<^) ViU (-<p 2i ) + A j2 



\ T,f=j+i\Cji\ 2 \C(j-i)i\ U (<pji) ViU (-^.^i) + A j{j _ 1} J 
In order for LHS — RHS, we must have 

l^p/VjUf-^) 



A" 



| 2 Vj-u (-<fe) £ l c ^l 2 u (^) V 4 U (-c 

f A 

]T \C^\ 2 \C pi \ 2 U {fai) V 4 U (-^) + Aj 



j 1 1 



Solving the equation above, we have 

A 



i a 



13 



,2 A 



|<7 



£ IC^^U^-OViUi 



- 4>ji) 



33 \ i=j+l 
A 

£ |C JI | 2 |C pi | 2 U(^)V l U(-0 p4 ) 
i=7+l 

Appendix C 
Proof of Lemma[8] 



First, consider the simple case where 



Cpj I 



(51) 



t = a, 



'ji 



and Pj = 0, that is, K Xj = 0. For this case, given ((27) we have 



A H = B 



a 
a 



for all i, j. It is easy to check that the eigenvalues of Kg. 



/I B ... B \ 
B T I B 



are Ai = 1 — a 



\ B^ ... I J 

and A2 = 1 + (j — 1) a, with multiplicity 2 (J — 1) and 2 respectively. Therefore, Kg is positive definite if < a < 1. 

\c l 2 J 

Now let us consider the case where m»j and Pj are small but non-zero, and PJ k are not necessarily equal to a. Denote the 
(p,q)th element of B by It is well known that the eigenvalues of symmetric matrix are locally (Lipschitz) continuous|9| 
with respect to its elements. Therefore, corresponding to every a 6 (0, 1), for any e > 0, there exist some strictly positive 



real numbers e a , e' a and e'^(C) such that if 



tt - a 



< e 



a 1 I *rj % 



< e' ai and Pj < e^(C) then every eigenvalues A s of ~K Sj 
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satisfies |A a — Ax] < e or |A S — Aa| < e. The bound on Pj may depend (7 to ensure that the two last terms in d27b are of 
bounded variation. For any < a < 1 we can always find some e > that guarantees A s > 0, and "Ks 3 is positive definite as 
a result. 



Appendix D 
Proof of Theorem[9] 



First we state a useful result from |8|. 



Lemma 16. (fi8\ Lemma 2]) Let X n = (X x , ■ ■ ■ , X n ) and Y_ n — (Y_i, ■ ■ ■ , Y n ) be two sequences of random vectors, and let 
X' G , Xn, Y_' G , and Y_q be Gaussian vectors with covariance matrices satisfying 



cov 



V 



1 ™ 



cov ~< cov 

\Y_J- \ Y_ G 



then we have 

h (X n ) < nh (2Lb) < nh (X G ) 
h{Y n \X n ) <nh{Y! G \X! G ) <nh(Y G \X G ) 

By Fano's inequality, the sum capacity of the generalized Z-channel ((23) must satisfy 



K 
(a) 



ne 



(t>) 



3=2 

3=2 3=2 
K j-1 

+ EE J (-i ; — op I ' " ' ' ^ii 

3=2 P =i 

3=2 

if 3-1 
3=2 p=l 

-/i ( 5" p | , • • • , £"i , ) 

A' 

+ ( ft (^3 ' ^0-2) ' • ■ • ' ^ii) 

3=2 



(d) 



(e) / » \ / A „ 

< nh (Z 1G ) -h[Y x XS 

+h(ss 1 )-h{ss 1 \xs) 

K j-1 
3=3 P=i— 1 
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K j-2 



3=3 P=l 
K-lj-1 



^2^2 h I ^j( P -i) > • ■ • > 

nn x^n \ 

X] X] ^ (— S> I — i(p-i) ' " ' ' — ii' — i ) 



i=3 p=i 
if j-i 



j=K P =i 



-X>(« 



j=2 



on nn on \ 

^■J'O'-I)'— J'0'-2)' ' ' ' ' ^Jl J 

on nn on -\^n 

^■jO'-i) ' ^0-2) ) • • • > ^.jl ) 





K 

+ h GSi) + ^2 h (^jo-i) £?o-2) . • • • , 

if j-2 
3=3 P=l 

^0-i)p| ^0-i)(p-i)' ' • ' ' ^0-i)i'— O'-i) J J 



if-1 



E7 / rrn I rm rm 



p=l 
if 



on on nji \ 

Aj'G'-i)' — j'0'-2)' " ' ' 2.31) 



J=2 
if 

® n/,(£ 1G )-/,(r;|x«) 
+/*os 1 )+f>(s?< 

i=3 

if-i 

- X ^ (— Kpl — *T(p-l)' ' ' ' ' -Kl'^ 
p=l 



nn on 
2-j(j-2), ' • • . iZjl 



+ 



nn on on \ 

^0'-l)'^j0'-2)' ' ' ' ' ^-jlj 



j=2 



on on on vn \ 



( =' n/>(y 1G )+f>(s; 



■3 0-1) 



j=3 



nil 

^■j"0'-2) 



j ; ±2. 



-^(]£k(k-i),---,I£ki) 



J=2 



on on on \ 

^■j0'-i)'-j'0'-2)' ' ' ' ' 



K 



J=2 



(y 1G ) W^ri) 



j=2 



on on 

^■j'O'-i)'— j'0'-2) 



■Jf(Jf-l)! " ■ ■ ! 



0) 



= "/i (£ 1G ) - (tv x , • • • , W K1 



+ 



(k) 



< nh (£ 1G ) - nh (N K , W K(K _ iy - ■ ■ , W Kl ) 

K 
J=2 

= nA (£ 1G ) - nh (n k , W K{K _ iy - ■ • , W K1 ) 
X>(^g) 



ijO-l)G'^jO'-2)G' ' ' ' ' iljlG 



j=2 
if 



+ n E ft (^j'0'-l)G'^jO'-2)G' " ' ' £jlG 
j=2 

n/i (£i G ) - nfc (iVjf, • • , Zjfi) 

J=2 
K 

~ n E ^ (§-j(j-l)G'Sj(j-2)Gi ' • • i £jK?) 
J=2 
K-l 

+n 

J=2 



y 



■jG 



+n 



E ft (-j'0'-l)G'^j(j-2)Gi • • • ) iSjlG 



y 



jG 



a:(a:-i)g> §-k(k-2)g 



K1G 



nh[Y 1G -nh[N K ,W 



-K(K-l)l ' ' > l^Jfl 



) 



E*M 

J=2 
AT 

~ n E ^ (^jO-i)G'^0-2)g ; ■ • • i 



J=2 
AT-1 



E ^ (%+i)0-i)G^o+i)0-2)G' • ' • ' £(j+l)lG 



+nh (W 



K(K-1)>WLk(K-2)i " '> -Ki-ifl 



TV 
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= nh (tic) - nh Wjc{k-i) . ■ • • . Wjf i) 

if 

a: 



3=2 
K 



+n 



j=3 



(£ig) - ^ (^jo • • • , IExi) 

K 

J2h(t jG )-h(S 21G ) 

3=2 
K 

E { h (^jO-l)G'^jO'-2)G! ■ ' ' ' £jK?) 



J=3 



iC7'-2)G>±2.jO-3) 



.jlG 



5' 



jO-i)g 



2).-"> lEjfl 



Kk) 

h : " ' ) Ai-K I ) 



i21G^ 



£fc(£ jG )-fc(Sa 

3=2 
K 

-n J> (^O-i)g) 

+n/i (w^f(A-_i), Wjf (JS -_2), • ■ •, Wjci iVjf) 
n/>(£ 1G )-nMjV K ) 

it*(t jG )-h(S 

3=2 
K 

E ft (-j'U-i)g) 



K 

+n 

3=2 
K 

-n 

3=3 
K-l 



21G) 



3 = 1 

+nh(Y KG ) -nh(N K ) 

K 



h f^O+iWc)) 



(a) is from Fano's inequality. 

(b) is from the expansion of mutual information: I ^Jf "; = /i (£i) — /i (X.i X™^j, an d the chain rule which gives 

i a,) = i (Zj; S,) + / yj| g,) .. 

(c) is from the chain rule, which gives I (X] ;§,•)= Ep=! * ( 2Q ; S jp \ S] (p _ 1} , • • • , S£ ) . 

(d) is from the expansion of mutual information. 

(e) is from the inequality h (tT) < nh 

(Y_ig)- ^ holds because Gaussian random variable maximize entropy under given 
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power constraint, and line 2 to line 6 in (e) is equivalent to line 2 and line 3 in (d). 
(f) is from the following equation: 

K-lj-l 

-h {Sj2i\2Q) - E E ^ (— 7p\ — " ' ' — ?i>— . 



j=3 p=l 



if j-1 



EE»( 



5 



(i-i)p 



5 



O-i) (p-i)' 



i=3 p=i 

(g) is from Lemma Because random variables 5%-l)p 

cm 

0-i)p 



(52) 



have the same marginal distribution, h (^S_f 
which gives 



c " 



on 

h-0-i)(p-i)' ' 



cm yn „ nr \ qn qn qn 

0-i)(p-i)' ' ^0'-i)i'— O'-i) ana ^-jpl^i(p-i)' ' ' ^tf'l 
j • • • j ^Q-i)D^(j-i)) and ^ (— ipl — i(p-i)' ' ' ' ' —j* 1 ) are ec l ua l' 



Eif v^j — 2 / i / qn I nn nn 
.7=3 Z^p=i y 1 \2-jp\ ^i(p-i). ' ' ' ' ^ii , 

-ft (^_i )p • • • > ^-1)1,^0-1))) = o. 

(h) Given S_ Kp = \C p k \ U p kX k + W_ Kp , the summation in the third line after (g) gives 



K-l 



E ^ (— ifpl — if (p-1)' ' ' ' ' §-Kli2L 

p=l 

E^^plE^p-Dr-.ffiS 



p=i 



nft W 



\W- K(K _ 1} ,---,W K1 ) 



It is also easy to see that S^i an d X.i 



X n have same marginal distribution, therefore 

h(mi)-h(±" X") = 



(53) 

(54) 
(55) 



(56) 



(i) Now combine the second and the last terms after (h): 



J2 h (^i0-i) 

J=3 



K 



E' 1 (^i(i-i) 

J=3 



— i(i-2) > ' * ' ' —7*1 i 



-MI, 



(h-i) 



reft (jVj^l w 



3i) - 


if 

-£*( 

J=2 


3i) - 


if 

i'=3 






2&) 





^.iO-i)'^J'0'-2)'' 



nn x^n \ 



y 



0-i) 



^0-1)0-2) 



nn 

' * " * ' — Ci 



i)i'^-0 



■if(if-l)' ■ " > IKifl 



(h-1) is from Lemma [6] Given that random variables Y_j-i 
have the same marginal distribution, we have 



nn 

>3 { , 



^■0-1)0-2)' ' " ' ' ^0-1)1'— O'-i) and 



■j 0-i) 



nn 

^■jO-2)'' 



(57) 
(58) 
(59) 

nn 

• • , <2ji 



l / nn nn on 

tt ^i0-i) %'0-2)' ' ' ' ' %-i 
(j) From chain rule of entropy, we know that 

h (W 



h(Y n 



0-1) 



on on yn 

i20-l)0-2),' • • , <2o-i)i'— 0-1) 



K(K-l)> " ' , 15-Jfl 



h(N K , W K{K _ 1} ,---, W Kl ), 



K{K-xy " ' > ii^ifi 



(60) 
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(k) is from Lemma [16] 

(1) is from the formula h (X\Y) = h (X) + h(Y\X) — h (Y). 
(m) is from 

if 

E h (-i(j-l)G>£jO'-2)G' • • • i tijlG 



3=2 
if-1 

i=2 



—jG 



y 



■jG 



X-KG 



+h ( £if(if-l)Gi&f(if-2)Gi " ' ) S.K1G 

(n) Combining Lemma [7] and Lemma [8] we know that for channels in C Q , if the power constraint Pj satisfies Pj < (" a , then 



X 



■jG 



YjG^Sj 



(61) 



form a Markov chain, and the following equality holds: 

= h (^2(3-1)G)^j0'-2)G) - - ' ) £jlG 



X-jGiH-jG 



G> " " ) iS(j+l)lG 



We can conclude that the achievable sum capacity of the generalized Z-channel must satisfy 

if if 

E 7 (— jG^jG, 



5> 



< max 

Tr (Vj) < SNRj i=i 



if 

max log 
Tr (Vj) < SNRj j=i 

V; h0,j = # 



if 



if 



«=3 



(62) 



(63) 



(64) 



Notice that for Z-channel, this sum capacity outer bound is achievable because the expression above is identical to the 
sum capacity achieved by treating interference as noise. Since the generalized Z-channel is obtained by eliminating some of 
the interference links from the interference channel, (l63l is an outer bound for the sum capacity of the interference channel. 
Theorem [9] is proved. 



Appendix E 
Proof of Theorem [Tol 

In Theorem [9] we have proved that the sum capacity ( BTT l of the generalized Z-channel is achieved by i.i.d. Gaussian input, 



if 



E 7 ^ ^ 



3=1 



if 

max E 7 fec5^Gf) 

■&CVi)<Pj 



(65) 



V.. 0../ !. •• . A 



if 



max log 
Tr{Y j )<P j 

v, 



i+Eiq,i 2 v 4 ] (i+ e i^i 2 v 4 

i=j+l 



(66) 



Define the normalized covariance matrix Vj = -p 2 -, Tr ( Vj J = 1. Consider the equal power constraint where Pj — p a^m/K 
for all users. 
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For an expression of the form log |I + xA\, let the eigenvalue of matrix A be < A, (A) < oo. Then 

n 

log|I + xA| = ^log(l +xXi (A)) 

i=l 

= £(*MA)-^ 2 A 2 (A) + (z 2 )) 

= xTr (A) - ix 2 Tr (A 2 ) + o (x 2 ) (67) 

The second equation uses Taylor's theorem for several variables at Xi (A) = x\ (A), since when x — > 0, x\ (A) — > as 
well. 

Combining d67]), ©, © and (ED, we find (O and (|34| >. 

Appendix F 
Proof of Theorem[TT1 

To maximize the right hand side of (I341 l. we need to solve the following optimization problem 

if 

min Vl ,.,v. X ; '' (v.;) 

3=1 

A"-l if 

+ 2 E E |Cj J -| 2 |C' J - < | 2 'ft(v i U i< ViU} i ) (68) 

./ I i=i+l 

S .i. Tr (V,) = 1 

Vj^O. (69) 

First, consider a simple case where the channel is strictly symmetric: <pji = 0, \Cjj\ 2 = 1 and \Cji\ 2 = a < 1 for all i, j. 
becomes 



K K-l K 

'Vi,-,V, 



,.,v„ E T H^ 2 )+2«E E Tl '(^j (70) 

3=1 3=1 i=3'+l 

s.t, Tr (v,) = 1 

Vj b 0. (71) 

Let the 2x2 real positive definite matrix Vj be 

^=(l jl I" 3 )- C72) 

V fc 33 Kj2 / 

Substituting d72l into f70l l, we construct a non-linear optimization problem from (JTOJl on standard form: 

K 

min klukl2M3 ,.:,kKukK2,k X3 E ( fc ii + k h + 2fc 3 2 s) ( 73 ) 

3 = 1 

if-1 if 

+2a (fcji^ii + ^2^2 + 2fcj3fc l3 ) 

j=l i=i+l 

s.t -fcji < (74) 

-k j2 < (75) 
k%-k. n k. j2 <Q (76) 
% + k j2 = 1 (77) 
for all j = 1,---,K 
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The optimal solution of the problem defined by (|73Tl~d77|i is also the optimal solution of the problem defined by (fTOl i. Denote 
the optimization problem defined by (F73T ) ~ (TTTb as (Pk), where k = (fcn, kia> ^13, ■ ■ ■ , kxi, kx 2 , kics) represents the set of 
feasible solutions. Notice that while any positive kj% , kj2 with kji + kj 2 < 1 satisfies the power constraint, we require constraint 
(ITTT i to be an equality. Because only when it is satisfied with equality, the system can achieve correct jf- 

mino 

Denote the objective function in ( 1731 1 by / (fc). Construct the Lagrangian function for problem (1731 1 as 

K K 

F{k, u^u^^v) = f (k) -^Ujikji -^2u j2 k j2 

3=1 i=i 

K K 

+ %3 (k% - k^kp) + v j (% + k j2 - 1) ■ (78) 

3=1 i=i 

To find a optimal solution for this problem, we use Karush-Kuhn-Tucker (KKT) sufficient condition. It is stated as followed. 
Theorem 17. (KKT Sufficient Condition MOj ) Consider an optimization problem (P) defined as 

min^ / (x) 
subject to gk (x) < 0, k = 1, • • • , m 
hi (x) = 0, I = 1, ■ ■ ■ , n, 

with Lagrangian function 

L(x,u,v) — f (x) + g (x) T u + h (x) T v 

Let x be a feasible solution of (P), and suppose (x,u,v) satisfy 

V £ i (x, u,v) = 
u > 
Uk9k (x) = 

Then if f (x) is a pseudoconvex function, gk (x), k — 1, • • • , m are quasiconvex functions, and hi (x), I = 1, • • • , n are linear 
functions, then x is a global optimal solution. 

Given (Pk), it is clear that the objective function / (fc) is a convex function, the equality constraints ( 1771 ) are linear, and the 
sets of inequality constraints ( |74l ), ([73}, and ( |76l i are convex. Notice that a convex function is a special case of pseudoconvex 
and quasiconvex. Comparing the standard problem (P) in Theorem [TTJ with our optimization problem (Pk), we can conclude 
that any feasible k satisfying 

VfcF (fc, u x ,u 2 , u 3 ,v) = 
u : , u 2 and u 3 > 
Ujikji = 
Uj 2 k ]2 = 
u j3 (k% - kjik j2 ) = 

is a global optimal for (Pfc). Solving V&F (k, Ui,u 2 , M3,v) we have 



= 2kji + 2a fcii - Uj\ - u ]3 k ]2 + Vj = 

I— 1,1^ J 

= 2^-2 + 2a 2^ fc l2 - Mj 2 - u j3kji + Vj = 



j 2 



23 



= Ak j3 + 4a 2^ fc l3 + 2u j3 k j3 = 0. 

It is easy to check that fc 3 i = fcj 2 = |> = while the Lagrange multipliers itji = Uj 2 = uj 3 = 0, and Vj = — 1 — a (K — 1) 
satisfy KKT condition. 

/I \ 

Therefore, fc^i = fcj2 = \, kj3 = 0, i.e. Y Xj = I 2 x I is a global optimal solution. Substitute this optimal solution 
into the formula of sum slope Q4t . the sum slope has upper bound 

2K 

So < 



aK + (1 - a) 



Appendix G 
Proof of Corollary [T2l 

Before proving this result, we state existing results for general parametric optimization problems. A general parametric 
optimization problem P (t) depending on parameters t e M r is defined by 

min / (x, t) 
subject to xe K" 

g% (x,t) < 0, i = 1,- • •, s 
9i(x,t) =0, i = s + 1, • • • , m 

where / and gi are real functions. Denote the parametric feasible region by 

A{t) = {x\x e K"; 9i(x,t) < Oifi = l,---, s; 
ft fei) = Oi/i = s + 1, • • • , m} . 

And denote the parametric optimal value function by v (t) = inf^g^^) / (x, i). The following theorem gives the sufficient 
condition under which v (t) is a continuous function of t. 

Theorem 18 (Theorem 3, p. 70, fTTI ). Suppose that 

1) the function f is continuous on xx tj 

2) the correspondence A is continuous on t; 

3) the subsets A (t) are non empty and compact 

Then the optimal value function v (t) is continuous and the correspondence optimal solution set is upper semi-continuous. 

Let C_ correspond to t, and let the k as that defined in Appendix [F] correspond to x of Theorem [18] It is easy to see that the 
objective function of d68l i is continuous on k x C_, while the feasible region A (C_) is non empty, compact, and independent of 
C_. Therefore, all three conditions in Theorem [18] are satisfied and the optimal value function / (k, C_) is continuous on C_. 

Further, in Theorem QT] we have shown that when C_ a = |c : <f>ji — 0, |Cjj| 2 = 1, \Cji\ 2 = a\ , the optimal value of the 
objective function of the optimization problem (<2 ) is 

f {hi £Lo) — — T r , /, r- 

aK + (1 — a) 

Given the continuity of f (k, (7 ) provided by Theorem [T8l . for any a, there exist ai, era, 173 such that for the channels 
C £ C a , where the set C a is defined as 



Co = {C: |<^| <<7i 

< CT 2 



Cji\ 2 - a 



< cr 3 



CeC a }, 

the optimal value of the objective function of the optimization problem Pk (C_) satisfies 

\f (k, C) - f (k, C,)] < g. 

Notice that C a is defined in Theorem [9] 

Because led as a —> 1, for any positive a, there exists C a , such that for C_E C a its sum slope satisfies 

So < 2 + a, 

If the magnitude and phase of the channel coefficients are drawn from continuous random distribution, Pr (Ccrj > 0. 
And as o — \ 0, 

lim AS Q = — 

rr^O K 



